Imitating Agent Game Strategies Using a Scalable Markov Model
نویسندگان
چکیده
Humans exhibit regularities in almost everything they do. We describe a Markov model derived from the behavior patterns of an agent, which is used to determine strategies by predicting which action a user is likely to execute next. We evaluate the predictive accuracy of this approach on a large dataset collected from sample Wumpus World games. We demonstrate from this approach that, the model can correctly predict the user’s next action with minimal computation and memory resources. Such predictions can then be used to imitate player strategies in a variety of games and other strategic domains.
منابع مشابه
Endogenous Neighborhood Selection and the Attainment of Cooperation in a Spatial Prisoner’s Dilemma Game
There is a large literature in economics and elsewhere on the emergence and evolution of cooperation in the repeated Prisoner’s Dilemma. Recently this literature has expanded to include cooperation in spatial prisoner dilemma games where agents play only with local neighbors in a specified geography. In this paper we explore how the ability of agents to move and choose new locations and new nei...
متن کاملA Malware Detector Placement Game for Intrusion Detection
We propose and investigate a game-theoretic approach to the malware filtering and detector placement problem which arises in network security. Our main objective is to develop optimal detector algorithms taking into account attacker strategies and actions. Assuming rational and intelligent attackers, we present a two-person zero-sum noncooperative Markov security game framework as a basis for m...
متن کاملDynamic configuration and collaborative scheduling in supply chains based on scalable multi-agent architecture
Due to diversified and frequently changing demands from customers, technological advances and global competition, manufacturers rely on collaboration with their business partners to share costs, risks and expertise. How to take advantage of advancement of technologies to effectively support operations and create competitive advantage is critical for manufacturers to survive. To respond to these...
متن کاملCombining Opponent Modeling and Model-Based Reinforcement Learning in a Two-Player Competitive Game
When an opponent with a stationary and stochastic policy is encountered in a twoplayer competitive game, model-free Reinforcement Learning (RL) techniques such as Q-learning and Sarsa(λ) can be used to learn near-optimal counter strategies given enough time. When an agent has learned such counter strategies against multiple diverse opponents, it is not trivial to decide which one to use when a ...
متن کاملInformation Security Analysis Using Game Theory and Simulation
Information security analysis can be performed using game theory implemented in dynamic simulations of Agent-Based Models (ABMs). Such simulations can be verified with the results from game theory analysis and further used to explore larger scale, real world scenarios involving multiple attackers, defenders, and information assets. Our approach addresses imperfect information and scalability th...
متن کامل